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(54) Code amount control device and encoding apparatus using the same 



(57) There is provided a code amount control 
device for controlling a code amount in units of second 
blocks each consisting of a plurality of first blocks each 
consisting of a plurality of sample value data, including 
a quantization unit for quantizing the second block data 
with predetermined quantization parameters, a detec- 
tion unit for detecting the code amount of the second 
block data quantized by the quantization unit and a 
control unit for controlling the quantization parameters 
in units of first blocks in accordance with an output from 
the detection unit. 

There is also provided an encoding apparatus 
including a block forming unit for dividing an input signal 
into blocks each consisting of a plurality of sample val- 
ues, an orthogonal conversion unit for orthogonally con- 
verting the input signal blocks, a detection unit for 
detecting the characteristic of each block in accordance 
with orthogonal conversion coefficients obtained by the 
orthogonal conversion unit, a selection unit for selecting 
optimal quantization parameters which can realize a 
constant code amount obtained when the input signal 
blocks are encoded in a unit consisting of a plurality of 
input signal blocks, a changing unit for changing the 



quantization parameters selected by the selection unit 
in accordance with an output from the detection unit, 
and an encoding unit for encoding the orthogonal con- 
version coefficients from the orthogonal conversion unit 
using the quantization parameters charged by the 
changing unit. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] The present invention relates to an encoding 
apparatus using variable length encoding and, more 
particularly, to code amount control. 

Related focKqrwnci Art 

[0002] In recent years, commercial VTRs for encod- 
ing an image signal with high efficiency, and record- 
ing/reproducing the encoded image signal on/from a 
recording medium such as a magnetic tape have been 
proposed. 

[0003] As a technique for compressing and encod- 
ing an image signal with high efficiency, an encoding 
apparatus using orthogonal conversion is known. In this 
apparatus, after an image is divided into blocks (to be 
referred to as discrete cosine transform (DCT) blocks 
hereinafter) each consisting of a predetermined number 
of pixels, the DCT blocks are subjected to orthogonal 
conversion such as DCT conversion, and converted 
DCT coefficients are quantized to perform, eg., entropy 
encoding. 

[0004] As a method of high-efficiency encoding, a 
variable length encoding method with a high compres- 
sion ratio tends to be used. 

[0005] When data is recorded on a recording 
medium using variable length codes, it is desirable that 
a predetermined number of DCT blocks have a constant 
information amount in consideration of a special repro- 
duction mode, error propagation, and the like. 
[0006] A conventional encoding apparatus will be 
described below. 

[0007] Ftg. 1 is a block diagram of a conventional 
encoding apparatus. Note that two-dimensional DCT 
conversion is performed in units of small-size blocks 
each consisting of 8 pixels (horizontal) x 8 pixels (verti- 
cal) of an image signal, and the information amount is 
controlled to be constant in units of large-size blocks 
each consisting of 30 DCT blocks. 
[0008] Referring to Fig. 1, a sample value of an 
image signal is input from an input terminal 1, and a 
large-size block forming circuit 2 selects 30 DCT blocks 
as a large-size block from 1 -frame data according to an 
arbitrary rule. 

[0009] This image signal is then supplied to a small- 
size block forming circuit 3, and is divided into small- 
size blocks each consisting of 8 x 8 pixels. 
[0010] A sample value of the image signal divided 
into the small-size blocks is input to an orthogonal con- 
version circuit 4, and the small-size blocks are DCT-con- 
verted, thus outputting 64 conversion coefficients in 
units of small-size blocks. 

[0011] The conversion coefficients are stored in a 



buffer circuit 5 in units of large-size blocks, and are also 
supplied to a code amount calculation circuit 7. The 
code amount calculation circuit 7 calculates the code 
amount of each large-size block upon encoding, and 
5 outputs the calculation result to a quantizer selection 
circuit 8. 

[0012] The quantizer selection circuit 8 selects a 
quantizer (or a quantization table) which can achieve a 
predetermined code amount, i.e., a code amount equal 
io to or smaller than a target code amount, in accordance 
with the input result. 

[001 3] A quantizer 6 quantizes the conversion coef- 
ficients delayed by the buffer circuit 5 using the quan- 
tizer selected by the quantizer selection circuit 8. The 

15 quantized conversion coefficients are subjected varia- 
ble length encoding such as Huffman encoding by a var- 
iable length encoding circuit 9, and the encoded data 
are output from an output terminal 10. 
[0014] The conventional problems will be explained 

so below with reference to Figs. 2 A and 2B. 

[0015] Figs. 2A and 2B show the relationship 
among a code amount achieved by a finally selected 
quantizer Q n , a code amount achieved by a quantizer 
Q rv1 smaller by one than the quantizer Q n , and a target 

25 code amount. In Figs. 2A and 2B, arrows a and b 
respectively represent the differences between the tar- 
get code amount and the code amounts achieved by the 
quantizers Q n and Q n -i- More specifically, when data is 
quantized by the quantizer Q nt the code amount is 

30 smaller by a than the target code amount When data is 
quantized by the quantizer Q n . 1# the code amount 
exceeds the target code amount by b. 
[0016] In the case of Fig. 2A, the value a is small, 
and encoding efficiency is high. However, in the case of 

35 Fig. 2B, the code amount is smaller by a considerably 
large value a than the target code amount, and encod- 
ing efficiency is low. In this case, the quantizer Q n _ 1 is to 
be selected if possfcle. However, since the code amount 
quantized by the quantizer Q n _-) slightly exceeds the tar- 

40 get code amount by b, the quantizer Q n must be 
selected. In this manner, in the conventional apparatus, 
encoding with high efficiency cannot always be per- 
formed. 

[0017] Conventional code amount control does not 
45 consider the visual characteristics of man. For example, 
the visual characteristics of man have steep discrimina- 
tion characteristics for a relatively bright fine image, but 
have low identification ability for a dark fine image. 
Therefore, in the conventional control wherein the same 
so quantization processing is performed for high-frequency 
components of tow-luminance image data and those of 
middle- or high-luminance image data, high-frequency 
noise appears in a portion having a low luminance and 
a high degree of fineness, resulting in a visual obstacle. 
55 [0018] Also, since the visual characteristics of man 
are lowered with respect to a moving image, image 
quality can be averaged by assigning a larger informa- 
tion amount to blocks with a small movement than 
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blocks with a large movement. However, since the con- 
ventional method does not consider any movement, the 
above-mentioned control cannot be performed. 
[0019] The present invention has been made in 
consideration of the above situation, and has as a con- s 
cem the provision of a code amount control device, 
which can effectively use a target code amount with 
minimum waste, and an encoding apparatus using the 
same. 

[0020] in accordance with a preferred aspect of the io 
present invention, there is provided a code amount con- 
trol device for controlling a code amount in units of . sec- 
ond blocks each consisting of a plurality of first blocks 
each consisting of a plurality of sample value data, com- 
prising quantization means for quantizing the second is 
block data with predetermined quantization parameters, 
detection means for detecting a code amount of the 
second block data quantized by the quantization 
means, and control means for controlling the quantiza- 
tion parameters in units of first blocks in accordance so 
with an output from the detection means. 
[0021 ] It is another concern of the present invention 
to provide an encoding apparatus which performs high- 
efficiency encoding in consideration of the visual char- 
acteristics of man. 25 
[0022] In accordance with another preferred aspect 
of the present invention, there is provided an encoding 
apparatus for dividing image information into blocks 
each consisting of a plurality of pixels, and encoding the 
image information by performing orthogonal conversion 30 
and quantization in units of blocks, comprising detection 
means for detecting local fineness characteristics of the 
image information from orthogonally converted conver- 
sion coefficients, and control means for controlling 
quantization characteristics in accordance with an out- 35 
put from the detection means. 
[0023] Other concerns and advantages of the 
invention will become apparent from the following 
detailed description taken in conjunction with the 
appended claims. 40 

BRIEF DESCRIPTION OF THE DRAWINGS 



[0024] 



45 



Fig. 1 is a block diagram of a conventional encoding 
apparatus; 

Figs. 2A and 2B are views for explaining conven- 
tional code amount control; 

Fig. 3 is a block diagram of a code amount control so 
device according to the first embodiment of the 
present invention; 

Fig. 4 is a chart showing a process until one quan- 
tizer is selected; 

Fig. 5 is a block diagram showing the arrangement ss 
of operation units 110 and 1 10' in Fig. 3; 
Fig. 6 is a block diagram showing the arrangement 
of an operation unit 1 15 in Fig. 3; 



Fig. 7 is a view for explaining the operation of a 
quantization parameter conversion unit 113 in Fig. 
3; 

Fig. 8 is a block diagram of a code amount control 
device according to the second embodiment of the 
present invention; 

Fig. 9 is a block diagram showing the arrangement 
of an operation unit 308 in Fig. 8; 
Fig. 1 0 is a block diagram showing the arrangement 
of a quantization parameter operation unit 322 in 
Fig. 8; 

Fig. 1 1 is a block diagram showing the arrangement 
of an encoding apparatus according to the third 
embodiment of the present invention; 
Fig. 1 2 is a block diagram showing the arrangement 
of main part of the encoding apparatus shown in 
Fig. 11; 

Fig. 13 is a chart showing a quantization No. binary 
search process according to the third embodiment; 
Fig. 1 4 is a block diagram showing the arrangement s 
of an encoding apparatus according to the fifth 
embodiment of the present invention; 
Fig. 15 is a view for explaining DCT conversion 
coefficient data and image characteristics; 
Fig. 16 is a view showing the distribution of signifi- 
cant coefficients of AC components in a low-fre- 
quency image; 

Fig. 17 is a view showing the distribution of signifi- 
cant coefficients of AC components in a horizontal 
high-frequency image; 

Fig. 18 is a view showing the distribution of signifi- 
cant coefficients of AC components in a vertical 
high-frequency image; 

Fig. 19 is a view showing the distribution of signifi- 
cant coefficients of AC components in a diagonal 
direction high-frequency image; 
Fig. 20 is a circuit diagram for realizing image char- 
acteristic discrimination based on DC components 
by an image characteristic discrimination circuit 604 
in Fig. 14; 

Figs. 21 A and 21 B are explanatory views of a 
change in weighting coefficient of image character- 
istics; 

Fig. 22 is a view showing an example of divided fre- 
quency areas upon quantization; 
Fig. 23 is a block diagram showing the arrangement 
of an encoding apparatus according to the sixth 
embodiment of the present invention; 
Figs. 24A and 24B are explanatory views of an 
adaptive change of divided frequency areas; 
Figs. 25A and 25B are explanatory views of a 
change in DCT weighting coefficient; 
Fig. 26 is a block diagram showing the arrangement 
of an encoding apparatus according to the seventh 
embodiment of the present invention; 
Fig. 27 is a view for explaining the relationship 
between the classes and the quantization steps in 
the seventh embodiment; 
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Fig. 28 is a view for explaining an operation for 
changing classes in the seventh embodiment; and 
Fig. 29 is a block diagram of a VTR adopting an 
encoding apparatus according to the present inven- 
tion. 5 



DETAILED DESCRIPTION OF THE FREFFRRFn 
EMBODIMENTS 



[0025] A code amount control device according to 10 
the first embodiment of the present invention will be 
described below. 

[0026] Fig. 3 is a block diagram of the code amount 
control device of the first embodiment Note that the 
code amount control device in Fig. 3 corresponds to the is 
code amount calculation circuit in the conventional 
encoding apparatus. 

[0027] Referring to Fig. 3, the device comprises 
input data 101 such as image data, a quantization 
parameter discrimination unit 102, quantization param- 20 
eters 103, an initial quantizer number generator 104, 
quantizer number data 105 to 108, a target code 
amount generator 109, operation units 110, code 
amount difference data 111, nonchanged quantization 
parameters 112, a quantization parameter conversion 25 
unit 113, changed quantization parameters 114 and 
116. an operation unit 115 for performing processing 
different from that in the operation unit 1 10, discrimina- 
tion data 117 indicating a code amount discrimination 
result, a switch 1 18, final quantization parameters 119, so 
quantizer number data 120 indicating a final quantizer 
(or quantization table), and data 121 indicating whether 
the code amount difference data 1 1 1 is difference data 
over or under a target code amount. 
[0028]. The operation from the input to the third 35 
operation unit 110 in Fig. 3 will be briefly described 
below. 

[0029] If N quantizers are available, quantizers are 
numbered from 1 to N in turn from a quantizer having a 
smaller quantization width, and are specified by Q n (n = 40 
1 toN). 

[0030] In order to determine a proper quantizer, for 
example, a binary search method is used. More specifi- 
cally, a central quantizer is selected, and quantiza- 
tion and variable length encoding are actually executed 4s 
to calculate a code amount. If the calculated code 
amount is smaller than the target code amount, since a 
target quantizer is present between Q 1 and Q^, a sim- 
ilar calculation is repeated using a quantizer 
between these quantizers. Conversely, if the calculated so 
code amount is larger than the target code amount, a 
similar calculation is repeated using a quantizer Q 3nM . 
In this manner, when there are N quantizers, a target 
quantizer can be determined by log 2 N calculations. 
[0031] Fig. 4 shows a quantizer selection process ss 
when N = 16. 

[0032] Referring to Fig. 4, an arrow 130 indicates a 
selection direction when the code amount is smaller 



than the target code amount, and an arrow 131 indi- 
cates a selection direction when the code amount is 
larger than the target code amount. In Fig. 4, an arrow 
132 represents a selection path until a quantizer Q 6 is 
selected. 

[0033] For the sake of easy description, if the 
number of small-size blocks included in one large-size 
block is represented by k, input data 101 is assumed to 
have conversion coefficients for k small-size blocks. 
[0034] The quantization parameter discrimination 
unit 102 assigns parameters representing the features 
of blocks to k small-size blocks, respectively, and out- 
puts these parameters as quantization parameters 1 03. 
When a certain quantizer Q n is selected for one large- 
size block, the quantization parameters 103 are used for 
control not to quantize all the k small-size blocks 
included in the large-size block by a single quantizer Q n , 
but to select quantizers (e.g., CW 2 , Q n+1 , Q n . 1( 
and the like) relatively slightly shifted from the quantizer 
Q n to the small-size blocks. 

[0035] The operation units 110 and 110' are por- 
tions for performing the above-mentioned one calcula- 
tion cycle. The first operation unit 1 1 0 receives the input 
data 101, the quantization parameters 103, initial quan- 
tizer number data from the initial quantizer number gen- 
erator 104, and the target code amount from the target 
code amount generator 109, and calculates a code 
amount for one large-size block (k small-size blocks). 
Then, the first operation unit 110 outputs a quantizer 
number 105 to be used in a calculation of the next oper- 
ation unit. 

[0036] (Jpon repetition of this calculation by the 
operation units 110 and 110', quantizer number data 
108 for one large-size block is obtained. 
[0037] Since this embodiment has 16 different 
quantizers, one quantizer number data can be obtained 
by the four operation units 1 10 and 110\ In this case, 
the initial quantizer number generator 104 supplies data 
indicating quantizer number 8 to the first operation unit 

110 (see Fig. 4). 

[0038] The quantization parameter conversion unit 
113 changes some of k quantization parameters 112 
corresponding to the k small-size blocks in accordance 
with the absolute value of code amount difference data 

1 1 1 output from the operation unit 1 10' to bring the cal- 
culated code amount close to the target code amount. 
The unit 1 13 then outputs changed quantization param- 
eters 114. The operation unit 115 calculates a code 
amount again using the quantization parameters 114 
and the quantizer number data 108 obtained by the 
operation unit 110'. 

[0039] As a result of this calculation, if the calcu- 
lated code amount is equal to or smaller than the target 
code amount, i.e., if discrimination data 117 is minus, 
changed new quantization parameters 116 (equal to the 
quantization parameters 1 1 4) are output as final quanti- 
zation parameters 1 1 9 via the switch 1 1 8. 
[0040] On the contrary, if the calculated code 
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amount exceeds the target code amount i.e., if the dis- 
crimination data 117 is plus, the nonchanged quantiza- 
tion parameters 112 (equal to the quantization 
parameters 103) are output as the final quantization 
parameters 119. In the latter case, encoding efficiency 
cannot be improved. 

[0041 ] The arrangement and operation of the oper- 
ation units 110 and 110* will be described below. 
[0042] Fig. 5 is a block diagram showing the 
arrangement of the operation units 110 and 1 10*. 
[0043] Referring to Fig. 5, the operation unit 110 
(110*) comprises input data 201 such as image data, 
quantization parameters 202, input quantizer number 
data 203, target code amount data 204, a quantization 
unit 205, a quantizer selection unit 206, a variable 
length encoding unit 207, a code amount addition inte- 
gration unit 208, a subtracter 209, a code discrimination 
unit 210, a quantizer number selection unit 21 1 , output 
quantizer number data 212, code amount difference 
data 21 3, discrimination data 214 indicating the discrim- 
ination result of the code discrimination unit 210, and 
actual code amount data 215. 

[0044] Note that the operation unit 110' outputs 
code amount difference data 213 and discrimination 
data 214 to an external circuit, but the operation unit 
1 10 does not output them to an external circuit 
[0045] The operation of the operation unit 110 with 
the above arrangement will be described below. 
[0046] The quantizer selection unit 206 selects one 
quantizer or quantization table in accordance with quan- 
tizer number data 203 and quantization parameters 
202, and the quantization unit 205 quantizes input data 
201 using the selected quantizer or quantization table. 
[0047] Since the input data 201 includes conversion 
coefficients for one large-size block, i.e., for k small-size 
blocks, and the quantization parameters 202 are 
changed in units of small-size blocks, the quantizer 
selection unit 206 shifts the quantizer or quantization 
table to be selected in accordance with these data. 
[0048] The variable length encoding unit 207 per- 
forms variable length encoding of the quantized data, 
and outputs the code length of the encoded data to the 
code amount addition integration unit 208. 
[0049] The code amount addition integration unit 

208 adds and integrates the input code lengths for the k 
small-size blocks, and outputs an actual code amount of 
the large-size block corresponding to the input quantizer 
number data 203 to the subtracter 209. The subtracter 

209 subtracts target code amount data 204 from the 
output data 21 5 from the code amount addition integra- 
tion unit 208, and outputs code amount difference data 
213. 

[0050] When the code amount difference data 213 
is plus, it indicates that quantization by the current 
quantizer number generates too large a code amount; 
when it is minus, it indicates that the code amount is 
small. 

[0051] Thus, the code discrimination unit 210 dis- 



criminates the polarity (i.e., plus or minus) of the code 
amount difference data 213. The quantizer number 
selection unit 211 converts the quantizer number data 
203 in accordance with discrimination result data 214 

5 from the code discrimination unit 210, and outputs out- 
put quantizer number data 21 2 to the next circuit. 
[0052] The operation of the quantizer number 
selection unit 21 1 will be described in detail below. 
[0053] If the input quantizer number is represented 

10 by n, the selection unit 211 selects n+fNte™ 1 ) when 
the code amount is over the target code amount; it 
selects n-(N/2 m+1 ) when the code amount is under the 
target code amount. 

[0054] Note that N indicates the number of quantiz- 
75 ers, and m indicates the m-th stage of the operation 
units shown in Fig. 3. In Fig. 3, N = 16 and m = 1 to 4. In 
the operation unit 1 10', the output quantization number 
becomes a value below the decimal point, and it is 
rounded to n+1 when the code amount is over the target 
20 code amount; it is rounded to n when the code amount *• 
is under the target code amount. 
[0055] The arrangement and operation of the oper- 
ation unit 115 will be described below. 
[0056] Fig. 6 is a block diagram showing the 
25 arrangement of the operation unit 115 in Fig. 3. Note 
that the same reference numerals in Fig. 6 denote the 
same parts as in Rg. 5, and a detailed description 
thereof will be omitted. 

[0057] The quantizer selection unit 206 selects one 
30 quantizer or quantization table in accordance with the 
quantizer number data 108 and the quantization param- 
eters 114. The quantization unit 205 quantizes input 
data (same as the input data 101 in Fig. 3) using the 
selected quantizer or quantization table. Note that the 
35 quantization parameters 1 14 are output to the next cir- 
cuit (corresponding to the quantization parameters 116 
in Rg. 3). 

[0058] Since the input data includes conversion 
coefficients for one large-size block, i.e., for k small-size 

40 blocks, and the quantization parameters 202 are 
changed in units of small-size blocks, the quantizer 
selection unit 206 shifts the quantizer or quantization 
table to be selected in accordance with these data. 
[0059] The variable length encoding unit 207 per- 

4$ forms variable length encoding of the quantized data, 
and outputs the code length of the encoded data to the 
code amount addition integration unit 208. 
[0060] The code amount addition integration unit 

208 adds and integrates the input code lengths for the k 
so small-size blocks, and outputs an actual code amount of 

the large-size block corresponding to the input quantizer 
number data 108 to the subtracter 209. The subtracter 

209 subtracts target code amount data 204 from the 
output data 215 from the code amount addition integra- 

55 tion unit 208, and outputs code amount difference data 
213. 

[0061] When the code amount difference data 213 
is plus, it indicates that quantization by the current 
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quantizer number generates too large a code amount; 
when it is minus, it indicates that the code amount is 
small. 

[0062] Thus, the code discrimination unit 210 dis- 
criminates the polarity (i.e., plus or minus) of the code 
amount difference data 213, and outputs discrimination 
data 214 (corresponding to the discrimination data 117 
in Fig. 3) according to the discriminated polarity. 
[0063] The operation of the quantization parameter 
conversion unit 1 13 in Fig. 3 will be described below. 
[0064] Fig. 6 is a view for explaining the operation of 
the quantization parameter conversion unit 113 in Fig. 
3. 

[0065] When the code amount difference data 1 1 1 
is minus, since this value corresponds to Fig. 2A, the 
quantization parameters are changed when the differ- 
ence data is equal to or negatively larger than a thresh- 
old value TH1. When the difference data falls within a 
range from 0 to TH1, it is determined that efficiency is 
sufficiently high, and the quantization parameters are 
not changed. 

[0066] When the code amount difference data 1 1 1 
is plus, this value corresponds to Fig. 2B. In this case, 
since the code amount is over the target code amount! 
a calculation for a quantizer smaller by 1 than the quan- 
tizer number data 108 obtained by the fourth operation 
unit 1 10' is performed. In this case, when the difference 
value is equal to or larger than a threshold value TH2. 
the quantization parameters are changed; when the dif- 
ference data falls within a range from 0 to TH2, the 
quantization parameters are not changed. 
[0067] The quantization parameters can be 
changed by the following method. That is, some of k 
parameters corresponding to the k small-size blocks are 
selected, and are changed in a direction to increase the 
code amount For example, when the k small-size 
blocks consist of a luminance signal and color differ- 
ence signals, the quantization parameters of blocks of 
the luminance signal which largely influences image 
quality can be changed. 

[0068] A code amount control device according to 
the second embodiment of the present invention will be 
described below. 

[0069] Rg. 8 is a block diagram of the code amount 
control device of the second embodiment Note that the 
code amount control device shown in Rg. 8 corre- 
sponds to the code amount calculation circuit in the con- 
ventional encoding apparatus. 

[0070] Refeiring to Rg. 8, the code amount control 
device comprises input data 301 such as image data, a 
quantization parameter discrimination unit 302, quanti- 
zation parameters 303, an initial quantization number 
generator 304. an initial short data amount generator 
305, an initial excess data amount generator 306. a tar- 
get code amount generator 307, operation units 308, i 
quantizer number data 309, 312, 315, and 319, short 
data amounts (signal lines) 310, 313, 316, 320, excess 
data amounts (signal lines) 311, 314, 317, and 321, 



quantization parameters 318 before operation, a quanti- 
zation parameter operation unit 322, and quantization 
parameters 323 after operation. 

[0071] Each operation unit 308 will be briefly 
s described below. 

[0072] In this case, the second operation unit will be 
exemplified. 

10073] A code amount calculation is performed 
based on quantizer number data 309, and one of a 
10 short data amount 310 or an excess data amount 31 1 
input from the previous operation unit is updated. The 
updated data amount is output to the next operation unit 
as a short data amount 313 or an excess data amount 
314. The short/excess data amount represents the dif- 
15 ference between a code amount obtained based on the 
current quantizer number and a target code amount 
[0074] The above-mentioned operation is per- 
formed by the operation units 308, and a final short or 
excess data amount 320 or 321 is obtained. Strictly 
20 speaking, if a quantizer indicated by finally determined 
quantizer number data 319 is represented by Q n , the 
data 320 represents a short data amount from the target 
code amount upon execution of encoding using the 
quantizer Q n , and the data 321 represents an excess 
25 data amount from the target code amount upon execu- 
tion of encoding using a quantizer Q n _.,. These data 
amounts respectively correspond to Figs. 2A and 2B. 
[0075] The quantization parameter operation unit 
322 operates quantization parameters 318 (which have 
30 the same contents as those of the quantization parame- 
ters 303 but are delayed) using the short/excess data 
amount, and outputs new quantization parameters 323. 
The quantization parameters 323 are parameters for 
instructing to use quantizers relatively shifted from the 
35 quantizer Q n in units of small-size blocks with respect to 
the quantizer Q n which is selected in units of large-size 
blocks. The code amount can be finely adjusted by 
operating some of k parameters. 
[0076] The arrangement and operation of each 
40 operation unit 308 will be described below. 

[0077] Fig. 9 is a block diagram showing the 
arrangement of the operation unit 308. 
[0078] Referring to Fig. 9, the operation unit 308 
comprises input data 401, quantization parameters 402, 
45 an input quantizer number 403, a quantization unit 404, 
a quantizer selection unit 405, a variable length encod- 
ing unit 406, a code amount addition integration unit 
407, an actual code amount (output line) 408, a target 
code amount 409, a subtracter 410, a code amount dif- 
50 ference 411, a code discrimination unit 412, data 413 
indicating the code discrimination result, an input short 
data amount 414, an input excess data amount 415, a 
switch 416, a quantizer number selection unit 417, an 
output quantizer number 418, an output short data 
?s amount (output line) 419. and an output excess data 
amount (output line) 420. 

[0079] Note that the units having the same names 
as those in Rg. 5 described in the first embodiment per- 
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form the same operations. 

[0080] The code amount addition integration unit 
407 outputs an actual code amount corresponding to 
the input quantizer number 403 onto the output line 408. 
The subtracter 410 subtracts the target code amount 
409 from the actual code amount 408, and outputs a 
code amount difference 41 1 . The code discrimination 
unit 412 discriminates the sign, i.e., the polarity (plus or 
minus) of the code amount difference 41 1 . 
[0081] Hie switch 416 updates either the input 
short data amount 414 or excess data amount 415 with 
the code amount difference 41 1 in accordance with data 
413 output from the code discrimination unit 412, and 
outputs the updated data amount onto one of the output 
lines 419 and 420. The data amount which is not 
updated is directly output For example, when the code 
amount is over the target code amount, the short data 
amount 414 is directly output and the excess data 
amount 415 is output after it is replaced with the data 
amount difference 41 1 -,• which exceeds the target code 
amount, by this operation unit 

[0082] With this arrangement the target 
short/excess data amount is obtained on the signal line 
320 or 321 via the four operation units 308 in Fig. 8. This 
will be described below with reference to Fig. 4. In Fig. 
4, the arrow 132 indicates a process until the quantizer 
Q 6 is selected. Following this arrow in the reverse direc- 
tion, it can be understood that code amount calculations 
for quantizers Q 6 and Q 5 are performed in the fourth 
and third stages, and a target data amount is obtained. 
[0083] Another case (Qg) will be examined below. A 
short data amount by the quantizer Q 9 is obtained in the 
fourth stage, and an excess data amount by the quan- 
tizer Q 8 is obtained in the first stage. In particular, the 
excess data amount in the first stage is transmitted to 
the last stage without being rewritten in middle stages 
since the code amount does not exceed the target code 
amount in the second to fourth stages. Note that in only 
the cases of Q n and Q 16 , since either of a short or 
excess data amount is not calculated at all, a correct 
result cannot be obtained. 

[0084] Fig. 10 is a block diagram showing the 
detailed circuit of the quantization parameter operation 
unit 322 shown in Fig. 8. The quantization parameter 
operation unit 322 comprises input quantization param- 
eters 501, a selected quantizer number (Q n ) 502, a 
short data amount 503, an excess data amount 504, a 
divider 505, a multiplier 507, an adder 509, a compara- 
tor 511, a switch 512, and output quantization parame- 
ters 513. 

[0085] If the input short and excess data amounts 
503 and 504 are respectively represented by a and b (a 
£ 0, b ^ 0) in correspondence with Figs. 2A and 2B, the 
divider 505 calculates a/(a + b) . and outputs a ratio 506 
of the current short data amount to an increase in code 
amount when the quantizer number is decreased by 1 . 
Decreasing the quantizer number by 1 is equivalent to 
operating all k quantization parameters without chang- 



ing the quantizer number so as to shift the quantizer 
number of each small-size block in a direction to 
decrease by 1 . This ratio 506 is multiplied with k by the 
multiplier 507, thus obtaining the number of parameters 

5 to be operated of the k parameters. 

[0086] The adder 509 operates the quantization 
parameters. More specifically, in this case, assume that 
the quantizer is shifted to one smaller by 1 by increasing 
parameters by 1 . Of the input k quantization parameters 

10 501 , the parameter values of parameters corresponding 
to the number of parameters designated by the output 
508 from the multiplier 507 are increased by 1 by the 
adder 509, and the updated parameters are output as 
new parameters 510. 

is [0087] The comparator 51 1 checks if the quantizer 
number 502 is 1 or 16. If the quantizer number is 1 or 
16, since the above-mentioned problem is posed, the 
switch 512 outputs the parameters 501 before opera- 
tion. In this embodiment, the number of parameters 

20 designated by the output 508 from the multiplier 507 is * 
defined by the ratio 506. However, in practice, since the 
code amount may exceed the target code amount, the 
number of parameters is preferably set to be a slightly 
small value. 

25 [0088] When the adder 509 increases the quantiza- 
tion parameter values, the order of small-size blocks to 
be operated may be determined by the following meth- 
ods. For example, when blocks include a Y signal and 
color difference signals, the blocks are operated in turn 

30 from the block corresponding to the Y signal. Alterna- 
tively, a block whose quantization parameter value is 
large is operated later, i.e., blocks are operated in turn 
from one having a small parameter value. 
[0089] The second embodiment has been 

as described. Hie basic principle of the present invention 
will be described again below. To operate to select a 
quantizer in which all the k quantization parameters of 
small-size blocks are smaller by 1 is equivalent to using 
the quantizer number Q n .-| in place of the quantizer 

40 number Q n of the overall large-size block without oper- 
ating quantization parameters at all. Therefore, when 0 
to k quantization parameters are operated, quantizers 
Q n to Qn.1 are equivalent^ obtained. 
[0090] A code amount control device according to 

45 the third embodiment of the present invention will be 
described below. 

[0091] First, an encoding apparatus having the 
code amount control device of this embodiment will be 
described. 

so [0092] Fig. 11 is a block diagram showing the 
encoding apparatus according to the third embodiment. 
The same reference numerals in Fig. 11 denote the 
same parts as in Fig. 1, and a detailed description 
thereof will be omitted. 

55 [0093] More specifically, the difference between the 
encoding apparatus of this embodiment and the con- 
ventional encoding apparatus shown in Fig. 1 is that a 
buffer circuit 11, a classification circuit 12, a code 
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amount estimation circuit 13, and a quantization circuit 
14 are arranged. Fig. 12 is a block diagram showing the 
detailed arrangements of these circuits. 
[0094] The encoding method of this embodiment 
will be described in detail below with reference to the 
accompanying drawings and tables. Table 1 below 
shows an example to which the present invention is 
applied, and summarizes offset amounts corresponding 
to quantization Nos. when quantizers are selected in 
units of small-size blocks by assigning offsets to the 
quantization No. of a large-size block on a single table in 
correspondence with Y/Cr/Cb. 



Table 1 





Y 


Cr 


Cb 


0 


-1 


-1 


-1 


1 








2 


0 


-1 


-1 


3 








4 


0 


0 


-1 


5 








6 


0 


0 


0 


7 








8 








9 








10 


+1 


0 


0 


11 








12 


+1 


+1 


0 


13 








14 


+1 


+1 


+1 


15 









10 



15 



[0095] Table 2 is a quantization table used in this 
embodiment, and Table 3 is a table showing constant 
offset amounts corresponding to class information. 

Table 2 



Band 


1 


2 


3 


4 


-3 


1/32 


1/32 


1/32 


1/32 


-2 


1/16 


1/32 


1/32 


1/32 


-1 


1/16 


1/16 


1/32 


1/32 


0 


1/16 


1/16 


1/16 


1/32 


1 


1/16 


1/16 


1/16 


1/16 


2 


1/8 


1/16 


1/16 


1/16 



40 



45 



SO 



SO 



25 



30 



35 



55 
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Table 2 (continued) 



Band 


1 


9 , 


o 


4 


3 
w 


1/R 
I/O 


i fa 

I/O 


l/lO 


1/16 


A 


1/ft 
I/O 


•t fa 
l/o 


4 /e 

l/o 


1/16 




1/ft 
I/O 


I/O 


i/o 


1/8 




1/4 
l/*r 


I/O 


l/8 


1/8 


7 


1/A 




1 /o 
I/O 


1/8 


Q 
O 


1/4 


1 IA 


1/4 


1/8 


Q 


1/A 


1/4 


1/4 


1/4 




1/9 


i IA 


i/4 


1/4 


1 1 
1 1 


1/fc 


1/2 


1/4 


1/4 


12 


1/2 


1/2 


1/9 
■ /£ 


1/A 


13 


1/2 


1/2 


1/2 


1/2 


14 


1 


1/2 


1/2 


1/2 


15 


1 


1 


1/2 


1/2 


16 


1 


1 


1 


1/2 


17 


1 


1 


1 


1 



Table 3 



Class 


1 


2 


3 


4 


Y 


+1 


0 


-1 


-2 


Cr 


0 


-1 


-2 


-2 


Cb 


-1 


-2 


-2 


-2 



[0096] In this embodiment, two-dimensional DCT 
conversion is performed in units of small-size blocks 
each consisting of 8 pixels (horizontal) x 8 pixels (verti- 
cal) of an input image signal, and the information 
amount is controlled to be constant in units of large-size 
blocks each consisting of 30 DCT blocks. 
[0097] The encoding apparatus according to this 
embodiment will be described below with reference to 
Rg. 12. 

[0098] Rg. 12 is a block diagram showing the 
arrangement of main part of the encoding apparatus 
shown in Rg. 11. 

[0099] Referring to Rg. 12, a sample value of a sig- 
nal S1 input from an input terminal t in is divided into 
large-size blocks by selecting 30 DCT blocks in units of 
1 -frame data according to an arbitrary rule, and each 
large-size block is divided into small-size blocks each 
consisting of 8 x 8 pixels. The small-size blocks are sub- 
jected to two-dimensional DCT conversion, and 64 con- 
version coefficients are output in units of small-size 
blocks. 
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[0100] The conversion coefficients S1 are supplied 
to the buffer circuit 1 1 , and are also supplied to the clas- 
sification circuit 12. The buffer circuit 11 comprises a 
plurality of buffer circuits 11a, 11b, 11c, and lid, and 
the input conversion coefficients are sequentially 
delayed in units of large-size blocks. 
[0101] The classification circuit 12 comprises an 
|AC| max detection circuit 12a and a classification circuit 
12b. The |AC| max detection circuit 12a obtains, e.g., a 
maximum amplitude value of the 63 coefficients exclud- 
ing a DC component in units of small-size blocks, and 
the classification circuit 12b classifies the small-size 
blocks into four classes in accordance with the values 
obtained by the |AC| max detection circuit 12a. The 
classification circuit 1 2 also comprises a discrimination 
circuit 12c for discriminating which one of Y/Cr/Cb an 
input signal is, and outputs an identification signal indi- 
cating the discrimination result of the discrimination cir- 
cuit 12c and the class information. 
[0102] Thereafter, for example, as shown in Fig. 13. 
the code amount estimation circuit 13 performs an esti- 
mation calculation of a code amount using a binary 
search method with respect to quantization Nos. Note 
that the code amount estimation circuit 13 of this 
embodiment comprises operation circuits 1 3a, 13b, 1 3c, 
and 13d which have the same arrangement. 
[0103] A quantization table circuit 20 arranged in 
each of the operation circuits 13a, 13b, 13c. and 13d 
receives the class information and the Y/Cr/Cb identifi- 
cation signal discriminated by the classification circuit 
1 2, and offsets shown in Table 3 corresponding to quan- 
tization Nos. are assigned to a quantization table of 
quantization No. 7 based on the class information and 
the Y/Cr/Cb identification signal in units of small-size 
blocks on the quantization table (an orthogonally con- 
verted coefficient region is divided into four bands to 
constitute a two<limensional table) shown in Table 2. 
[01 04] Furthermore, offsets corresponding to quan- 
tization Nos. shown in Table 1 are assigned based on 
the quantization No. and the Y/Cr/Cb identification sig- 
nal. For example, since a small-size block correspond- 
ing to class information 3 and Cb yields 7-2 + 0 = 5, it 
is quantized based on a table of quantization No. 5. 
[0105] The quantization steps selected by the 
quantization table circuit 20 Eire supplied to a quantizer 
21 in units of four divided bands of the small-size blocks. 
The quantizer 21 quantizes the input conversion coeffi- 
cients S1 with the quantization steps supplied from the 
quantization table circuit 20. The quantization results 
are supplied to a 0 detection circuit 22 for detecting a 
run of coefficients "0" and a Huffman table circuit 23, 
thereby outputting a code length obtained upon execu- 
tion of two-dimensional Huffman encoding based on the 
run length and the amplitude. 

[0106] The code length obtained upon execution of 
two-dimensional Huffman encoding is supplied to a 
count circuit 24 connected to the output side of the Huff- 
man table 23. The count circuit 24 adds and integrates 



code amounts after Huffman encoding, and outputs the 
integrated result to a discrimination circuit 25. The dis- 
crimination circuit 25 compares the input integrated 
result with a predetermined information amount, and 
5 supplies the comparison result to the next operation cir- 
cuit 13b. 

[01 07] The operation circuit 1 3b selects a quantiza- 
tion table in accordance with the result from the opera- 
tion circuit 13a. For example, when the table of 

10 quantization No. 7 is selected in the operation circuit 
13a, and when the code amount exceeds the predeter- 
mined information amount, as shown in Fig. 13. the 
operation circuit 1 3b estimates the code amount of each 
large-size block by assigning offsets in units of small- 

is size Mocks to a table of quantization No. 11 as in the 
operation circuit 13a. On the other hand, when the code 
amount does not exceed the predetermined information 
amount, the operation circuit 13b similarly estimates the 
code amount of each large-size block by assigning off- 

20 sets in units of small-size blocks to a table of quantiza- 
tion No. 3. Then, the operation circuit 13b compares the 
estimated code amount with the predetermined infor- 
mation amount, thereby determining a quantization No. 
of the next stage. 

25 [0108] The same operations as described above 
are performed in the subsequent operation circuits 13c 
and 13d, thereby determining a quantization No. corre- 
sponding to an information amount which does not 
exceed the predetermined information amount but is 

30 closest thereto. Then, the code amount estimation cir- 
cuit 13 supplies the determined quantization No. to the 
quantization circuit 14. The quantization circuit 14 com- 
prises a quantization table circuit 14a and a quantizer 
14b. The quantization table circuit 14a determines 

35 quantization steps on the basis of the determined quan- 
tization No., the class information, and the Y/Cr/Cb 
identification signal, and outputs them to the quantizer 
14b. 

[0109] The quantizer 14b receives the conversion 

40 coefficients which are delayed by a time corresponding 
to code amount estimation by the buffer circuit 1 1 , and 
finally quantizes the conversion coefficients with the 
quantization steps supplied from the quantization table 
circuit 14a. The quantized coefficients are output from 

45 an output terminal tout- Thereafter, the quantized coeffi- 
cients are subjected to variable length encoding such as 
two-dimensional Huffman encoding by a variable length 
encoding circuit 9 connected to the output side of the 
quantization circuit 14. 

so [01 10] An encoding method according to the fourth 
embodiment of the present invention will be described 
below. In the third embodiment described above, as 
shown in Table 1 , offsets are defined by assigning a pri- 
ority order to Y/Cr/Cb in correspondence with the quan- 

55 tization No. However, when the orthogonally 
transformed coefficient region are divided into some 
bands, offsets may be defined in correspondence with 
bands. 
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[0111] Table 4 below shows an example of offsets 
corresponding to quantization Nos. when the coefficient 
region is divided into four bands. 



Table 4 



Band 


1 


2 


3 


4 


0 


-1 


-1 


-1 


-1 


1 










2 


0 


-1 


-1 


-1 


3 










4 


0 


0 


-1 


-1 


5 










6 


0 


0 


0 


-1 


7 










8 


+1 


0 


0 


0 


9 










10 


+1 


+1 


0 


0 


11 










12 


+1 


+1 


+1 


0 


13 










14 


+1 


+1 


+1 


+1 


15 











[0112] In this embodiment, when quantization 
tables are selected in units of small-size blocks sub- 
stantially the same processing as in the third embodi- 
ment is executed except that processing using Table 1 is 
replaced by that using Table 4 ( and a detailed descrip- 
tion thereof will be omitted. 

[01 13] Also, offset amounts corresponding to quan- 
tutan . Nos. may be defined in correspondence with 
both Y/Cr/Cb and the bands of the coefficient region 
[0114] As described above, according to the third 
and fourth embodiments, the information amount 
obtained after encoding of each large-size block is con- 
trolled to be close to a predetermined value and a 
selection method of quantizers corresponding to 
natures in units of small-size blocks is changed in 
accordance with the quantization characteristics of a 
quantizer selected in units of large-size blocks. There- 
fore optimal quantizers can be selected in units of 
small-size blocks in accordance with the quantization 
characteristics of a quantization table determined in 
units of large-size blocks by defining quantization 
parameters such as class information while assigning a 
pr.or.ty order to Y/Cr/Cb, the bands of the coefficient 
reg.on, and the like in consideration of the visual char- 
acteristics. 

[0115] The fifth embodiment of the present inven- 
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30 



35 



40 



45 



50 



55 



tion will be described in detail below with reference to 
the accompanying drawings. 

[0116] Fig. 14 is a block diagram showing the 
arrangement of an encoding apparatus according to the 
fifth embodiment. Referring to Fig. 14, original image 
data 601 to be encoded is divided into blocks each con- 
sisting of 8 pixels x 8 lines in units of frames. The encod- 
ing apparatus shown in Fig. 14 comprises a DCT circuit 
602 for performing DCT conversion of the image data 
601 divided into blocks, and outputting AC components 
602a of DCT coefficients, a quantizer 603 for quantizing 
the AC components 602a f an image characteristic dis- 
crimination circuit 604 for discriminating fineness char- 
acteristics of an image on the basis of the outputs 602a 
and a DC component 602b of DCT coefficients output 
from the DCT circuit 602, and outputting a discrimina- 
tion result 604a, a quantization control circuit 605 for 
controlling the quantization characteristics of the quan- 
tizer 603 in accordance with the discrimination result 
from the image characteristic discrimination circuit 604 
a delay circuit 606 for delaying the DC component 602b 
of the DCT coefficients output from the DCT circuit 602 
by a time corresponding to the processing time of the 
quantizer 603. and a variable length encoding circuit 
607 for performing variable length encoding of the out- 
puts from the quantizer 603 and the delay circuit 606 
and outputting encoded data 608. 
[0117] The DCT circuit 602 performs twcxiimen- 
sional DCT conversion of the original image data 601, 
and outputs 64 conversion coefficient data (including 
one DC component indicating an average luminance 
level of 64 pixels, and 63 AC components), as shown in 
Fig. 15. The AC components 602a are supplied to the 
quantizer 603 and the image characteristic discrimina- 
tion circuit 604, and the DC component 602b is supplied 
to the delay circuit 606 and the image characteristic dis- 
crimination circuit 604. 

[0118] The image characteristic discrimination cir- 
cuit 604 discriminates the activity level of an image, i.e., 
the local degree of fineness, from the AC components 
602a and the DC component 602b. The image charac- 
teristic discrimination circuit 604 calculates the distribu- 
tion state of high-frequency significant coefficients of 
image data from the AC components 602a, and discrim- 
inates based on the calculation result if the input image 
corresponds to a low-frequency image shown in Fig. 1 6. 
a horizontal high-frequency image shown in Fig. 17, a 
vertical high-frequency image shown in Fig. 18, or a 
diagonal direction high-frequency image shown in Ra 
19. 

[0119] Furthermore, the image characteristic dis- 
crimination circuit 604 discriminates the local luminance 
level of the image from the DC component 602b. More 
specifically, the circuit 604 compares a level K of the DC 
component 602b with a low-luminance discrimination 
threshold value M using a comparator arrangement 
shown in Fig. 20, and discriminates a low luminance 
when K^M. When the circuit 604 discriminates the low 
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luminance based on the DC component 602b, it 
changes the activity level discriminated based on the 
AC components 602a to the low-frequency side, as 
shown in Figs. 21 A and 21 B. In other words, the circuit 
604 decreases weighting coefficients for high-frequency 
portions by a predetermined value or more. Thus, a dis- 
crimination result indicating a fine image (Fig. 21 A) is 
changed to a discrimination result indicating a low-fre- 
quency image (Fig. 21 B). 

[0120] Of course, when a low-frequency image is 
originally detected based on the AC components 602a, 
this discrimination result is not influenced by the evalua- 
tion result of the DC component 602b. 
[0121] The quantization control circuit 605 sets 
proper quantization characteristics according to the dis- 
crimination result 604a from the image characteristic 
discrimination circuit 604 in the quantizer 603. The 
quantizer 603 quantizes the AC components 602a out- 
put from the DC circuit 602, and the delay circuit 606 
delays, the DC component 602b output from the DCT 
circuit 602 by a time corresponding to the processing 
time of the quantizer 603. 

[0122] Note that, as shown in Fig. 22, the quantizer 
603 classifies conversion coefficient data from the DCT 
circuit 602 into a plurality of areas (four areas in Fig. 22), 
and quantizes data using different step widths in units of 
areas. 

[01 23] In general , the discrimination characteristics 
of eyes of man are sensitive to the low-frequency region 
but are not sensitive to the high-frequency region. 
Therefore, when data in the low-frequency region are 
quantized using a small step width, and data in the high- 
frequency region are quantized using a targe step width, 
a quantization distortion is caused to concentrate on the 
high-frequency region of the image, thus suppressing 
visual deterioration of image quality. 
[0124] In the divided areas shown in Fig. 22, four 
different quantization step widths are set from low-fre- 
quency components (class #0) to high-frequency com- 
ponents (class #3). 

[0125] As the class # increases, the quantization 
step width increases. 

[01 26] The variable length encoding circuit 607 per- 
forms variable length encoding of the DC component 
from the delay circuit 606 and the quantized AC compo- 
nents from the quantizer 603, and outputs encoded data 
608. 

[01 27] Note that the variable length encoding circuit 
607 converts two-dimensional quantized data output 
from the quantizer 603 into one-dimensional data by 
zigzag-scanning the data from the low-frequency region 
to the high-frequency region, then performs variable 
length encoding of the converted data by run-length 
encoding and two-dimensional Huffman encoding, and 
outputs the encoded data 608. In the run-length encod- 
ing, data are reversibiy compressed by counting zero 
runs. Also, in the Huffman encoding, short code words 
are assigned to data with high generation possibility, 



and long code words are assigned to data with low gen- 
eration possibility, thereby shortening the code word 
length in average. 

[0128] The sixth embodiment of the present inven- 

5 tion will be described below. 

[0129] Fig. 23 is a block diagram showing the 
arrangement of an encoding apparatus according to the 
sixth embodiment. Note that the same reference numer- 
als in Fig. 23 denote the same parts as in Fig. 14, and a 

10 detailed description thereof will be omitted. 

[0130] Referring to Fig. 23, the encoding apparatus 
comprises a two-dimensional low-pass filter (LPF) 610 
for selectively bard-limiting the AC components 602a 
output from the DCT circuit 602 in a two-dimensional 

is space in accordance with an external control signal, and 
a delay circuit 61 1 for delaying the DC component 602b 
output from the DCT circuit 602 by a time corresponding 
to the filtering time of the two-dimensional LPF 610. The 
output from the two-dimensional LPF 610 is supplied to 

20 the quantizer 603, and the output from the delay circuit 

611 is supplied to the delay circuit 606. 

[0131] The encoding apparatus also comprises an 
image characteristic discrimination circuit 612 for dis- 
criminating image characteristics in accordance with 

25 the AC components 602a and the DC components 602b 
output from the DCT circuit 602, and outputting a dis- 
crimination result 612a. The image characteristic dis- 
crimination circuit 612 also outputs a control signal 
612b for controlling the two-dimensional LPF 610 in a 

30 through state or filter state in accordance with the dis- 
crimination result. The contents of the discrimination 
result 612a are the same as the discrimination result 
604a (see Fig. 14) of the image characteristic discrimi- 
nation circuit 604. 

35 [0132] The operations of the two-dimensional LPF 
610, the delay circuit 61 1 , and the image characteristic 
discrimination circuit 612 will be described in detail 
below. The image characteristic discrimination circuit 

612 systematically discriminates-the activity level in 
40 accordance with the distribution of significant coeffi- 
cients of the AC components 602a and the luminance 
discrimination result based on the DC component 602b 
as in the image characteristic discrimination circuit 604 
(see Fig. 14), and outputs the same discrimination 

45 result 612a as the discrimination result 604a to the 
quantization control circuit 605. 
[01 33] Also, when the image characteristic discrim- 
ination circuit 612 discriminates a fine image with a low 
luminance, it starts the two-dimensional LPF 610 by the 

so control signal 612b to band-limit the AC components 
602a. Otherwise, the circuit 612 sets the two-dimen- 
sional LPF 610 in a through state, and causes it to out- 
put the AC components 602a after they are delayed by 
the same delay time as that of the delay circuit 611. 

55 Note that the delay circuit 61 1 delays the DC compo- 
nent 602) by a time corresponding to the processing 
time of the two-dimensional LPF 610. In the case of a 
fine image with a low luminance, the high-frequency 
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components of the AC components 602a are two- 
dimensionally eliminated, thereby suppressing expan- 
sion, in the high-frequency region, of an image. 
[0134] Thereafter, quantization and variable length 
encoding are executed by the quantizer 603 and the s 
variable length encoding circuit 607 as in the embodi- 
ment shown in Fig. 14. 

[0135] In the above embodiment, the activity dis- 
crimination result based on the AC components 602a is 
corrected based on the DC component 602b, and the 10 
quantization control circuit 605 controls the quantization 
characteristics of the quantizer 603 on the basis of the 
corrected discrimination result. Alternatively, the image 
characteristics may be discriminated using only the Ac 
components, and classes of quantization areas may be is 
changed based on the DC component 
[0136] The operation of this embodiment will be 
described below with reference to Figs. 24A and 24B. 
When the activity level of an image is discriminated by 
the AC components, and it is discriminated based on 20 
the DC component that the image has a low luminance 
as a whole, areas are changed to increase the quantiza- 
tion step widths of middle- and high-luminance quanti- 
zation areas (the areas are changed from Fig. 24A to 
Fig. 24B). 25 
[0137] In this manner, when quantization classes of 
local fine image data are changed in accordance with 
the DC component, if the image has a low luminance, 
data in the low-frequency region can be quantized using 
a small step width and data in the high-frequency region 30 
can be quantized using a large step width, thus realizing 
processing matching with visual characteristics. 
[0138] Also, weighting coefficients for decreasing 
high-frequency components as compared to those 
applied to low-frequency components may be applied to 35 
the high-frequency components in accordance with the 
DC conrponent. This embodiment will be described in 
detail below with reference to Figs. 25A and 25B. Fig. 
25A shows a three-dimensional expression of conven- 
tional weighting coefficients for DCT conversion coeffi- 40 
cient data, and Fig. 25B shows a three-dimensional 
expression of weighting coefficients according to this 
embodiment. 

[01 39] In Fig. 25A, the weighting coefficients for the 
highest frequency components in the horizontal and 45 
vertical directions are 0.7 with respect to a DC value, 
and hence, the weighting coefficient for the highest fre- 
quency component in the diagonal direction is 0.49 (« 
0.7 x 0.7). 

[0140] In contrast to this, according to this embodi- so 
ment, as shown in Fig. 25B, when the DC level is low- 
ered from a to b, and a low luminance is determined, the 
weighting coefficients for the horizontal and vertical fre- 
quencies are multiplied with a coefficient a (0 < a < 1), 
thereby eliminating significant coefficients of the high- 55 
frequency components. More specifically, the DCT 
weighting coefficients themselves are adaptively 
changed in accordance with the DC component like by 



calculating 0.7a on the horizontal and vertical frequency 
axes and 0.7a x 0.7a for the limit frequency component 
in the diagonal direction. Thus, the significant coeffi- 
cients of the high-frequency components can become 
close to 0 at low luminances. 

[0141] As can be easily understood from the above 
description, according to the fifth and sixth embodi- 
ments, the visual S/N ratio of a locally fine image with a 
low luminance can be improved. Since the code amount 
of the low-luminance components can be decreased, 
encoding efficiency can be improved as a whole. 
[0142] The seventh embodiment of the present 
invention will be described below. 
[0143] Fig. 26 is a block diagram showing the 
arrangement of an encoding apparatus according to the 
seventh embodiment. 

[0144] Referring to Fig. 26, image data input from 
an input terminal 701 is divided into blocks each con- 
sisting of 8 pixels (horizontal) x 8 pixels (vertical) by a 
block forming unit 702. The image data blocks are con- 
verted by an orthogonal conversion unit 703. For exam- 
ple, this orthogonal conversion unit 703 adopts an 
orthogonal conversion encoding method called discrete 
cosine transform (to be referred to as DCT hereinafter). 
[0145] The image data blocks from the block form- 
ing unit 702 are also supplied to a movement detector 
710. The movement detector 710 detects a movement 
of each block, and outputs the movement detection 
value to a classification unit 71 1 . 
[0146] The classification unit 711 classifies blocks 
to be processed into four classes in accordance with the 
information amounts of the blocks (fineness of images 
of the blocks), and outputs the classified blocks to quan- 
tizers 704a, 704b, 704c, and 704d and also to a multi- 
plexer 709. As the classification method of the 
classification unit 71 1 , a method of classifying blocks on 
the basis of a maximum value of the absolute values of 
AC components of DC conversion data, a method of 
classifying blocks on the basis of a square sum of AC 
components, and the like are used. In this embodiment, 
the blocks are classified into four classes, and the quan- 
tization step width increases from class 0 toward class 
3. 

[0147] The quantizers 704a, 704b, 704c, and 704d 
having different quantization step widths quantize 
orthogonally converted image data using the quantiza- 
tion step widths shown in Fig. 27 in correspondence 
with classes. 

[0148] More specifically, a block having a large 
information amount is quantized using a large quantiza- 
tion step width, so as to make the information amount 
generated by each block constant, thereby uniforming 
image quality. 

[0149] In the classification unit 711, when the 
movement is large, since the visual characteristics of 
man are lowered, the values of the classes shown in 
Fig. 27 are changed to those with larger quantization 
step widths, as shown in Fig. 28, and are output to the 
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quantizers 704a, 704b, 704c ( and 704d and the multi- 
plexer 709, so that quantization is performed based on 
larger quantization step widths. For example, when it is 
determined that an image which is normally determined 
to be class 1, has a large movement, its class is 
changed to class 2, and quantization of this image is 
performed based on a larger quantization step width 
than normal. 

[0150] In this manner, since the values of the 
classes are changed in correspondence with the move- 
ment amount, the quantization step widths shown in 
Fig. 27 are changed to those shown in Fig. 28, and an 
image with a large movement can be quantized using a 
larger quantization step width. 

[0151] The quantized data are output to a selector 
705, and are also output to delay units 706a, 706b, 
706c, and 706d. The delay units 706a, 706b, 706c, and 
706d delay the quantized data until the output result of 
the selector 705 appears, and then output the delayed 
data to terminals 707a, 707b, 707c, and 707d of a 
switch 707. The selector 705 switches the switch 707 to 
select a quantizer which can realize a predetermined 
information amount or less in predetermined processing 
units (e.g., 30 blocks), and outputs the selected quan- 
tizer number to the multiplexer 709. A variable length 
encoder 708 assigns code words in accordance with the 
frequencies of generated codes. That is. short code 
words are assigned to codes with a high generation fre- 
quency, and long code words are assigned to data with 
a low generation frequency, thereby reducing the infor- 
mation amount to be generated. The encoder 708 out- 
puts the encoded data to the multiplexer 709. 
[0152] The multiplexer 709 multiplexes the com- 
pressed image data, and the class value output from the 
classification unit 71 1 , and the quantizer number output 
from the selector 705, and outputs the multiplexed data 
from an output terminal 712. 

[0153] As described above, according to the sev- 
enth embodiment, since a movement of each block is 
detected, and the class value of each block is changed 
in accordance with this movement information, an 
actual quantization step width can be switched without 
adding any new change information. Since the quanti- 
zation step width is selected in accordance with the 
movement amount of an image, the image quality levels 
of a block with a large movement and a block with a 
small movement can be uniformed, and image quality 
can be improved. 

[01 54] Note that various other changes and modifi- 
cations may be made without departing from the spirit 
and scope of the invention. 

[0155] For example, the encoding apparatus 
described in each of the above embodiments may be 
applied to a video camera, a digital VTR, and the like. 
[0156] For example, Fig. 29 is a block diagram of a 
camera integrated VTR which comprises the encoding 
apparatus described in each of the above embodi- 
ments. 



[0157] Referring to Fig. 29, the VTR comprises an 
image pickup unit 801 for converting optical information 
into an electrical signal, a camera process circuit 802 for 
executing predetermined processing of the signal out- 

5 put from the image pickup unit, and outputting a video 
signal, an encoding circuit 803 which adopts the encod- 
ing method of each of the above embodiments, a 
recording process circuit 804 for executing predeter- 
mined processing (e.g., digital modulation) for record- 

io ing, a recording head 805, and a magnetic tape 806 as 
a recording medium. 

[0158] With the above-mentioned arrangement, the 
encoding apparatus of each of the above embodiments 
can be applied to the camera integrated VTR. 
is [0159] In other words, the foregoing description of 
embodiments has been given for illustrative purposes 
only and not to be construed as imposing any limitation 
in every respect 

[01 60] The scope of the invention is, therefore, to be 
20 determined solely by the following claims and not lim- 
ited by the text of the specifications and alterations 
made within a scope equivalent to the scope of the 
claims fall within the true spirit and scope of the inven- 
tion. 

25 [0161] Additional aspects of the present invention 
are also set out in the following clauses: 

1. A code amount control device comprising: 

30 a) input means for inputting information data in 

predetermined units; 

b) a plurality of stages of code amount opera- 
tion means for operating a code amount; 

c) calculation means for calculating a 
35 short/excess code amount with respect to a tar- 
get code amount in each of said code amount 
operation means; 

d) updating means for updating one of a short 
code amount and an excess code amount in 

40 accordance with a calculation result from said 

calculation means; and 

e) control means for controlling quantization 
parameters used upon encoding in accordance 
with the short/excess code amount obtained by 

4$ the final stage of said code amount operation 

means. 

2. A device according to clause 1 , further compris- 
ing: 

so 

encoding means for encoding the information 
data using the quantization parameters control- 
led by said control means. 

55 3. A device according to clause 2, further compris- 
ing: 

recording means for recording encoded data 
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encoded by said encoding means. 

4. A device according to clause 2, wherein said 
encoding means comprises orthogonal conversion 
means for orthogonally converting the information s 
data. 

5. A device according to clause 4, wherein the infor- 
mation data is image data, and said orthogonal 
conversion means performs DCT conversion. w 

6. A device according to clause 1, wherein said 
input means comprises image pickup means for 
electrically converting an optical image. 

15 

7. A code amount control device for controlling a 
code amount in units of second blocks each con- 
sisting of a plurality of first blocks each consisting of 
a plurality of sample value data, comprising: 

20 

a) quantization means for quantizing the sec- 
ond block data with predetermined quantiza- 
tion parameters; 

b) detection means for detecting a code 
amount of the second block data quantized by 25 
said quantization means; and 

c) control means for controlling the quantiza- 
tion parameters in units of first blocks in 
accordance with an output from said detection 
means. 30 

8. A device according to clause 7, further compris- 
ing: 

encoding means for encoding the first block 35 
data using the quantization parameters control- 
led by said control means. 

9. A device according to clause 8, further compris- 
ing: 40 

recording means for recording encoded data 
encoded by said encoding means on a record- 
ing medium. 

45 

10. A device according to clause 8. wherein the 
sample value data is image data. 

11. A device according to clause 10, wherein said 
encoding means comprises orthogonal conversion so 
means for orthogonally converting the first block 
data. 

12. An encoding apparatus comprising: 

55 

a) block forming means for dividing an input 
signal into blocks each consisting of a plurality 
of sample values; 



b) orthogonal conversion means for orthogo- 
nally converting the input signal blocks; 

c) detection means for detecting a characteris- 
tic of each of the blocks in accordance with 
orthogonal conversion coefficients obtained by 
said orthogonal conversion means; 

d) selection means for selecting optimal quanti- 
zation parameters which can realize a constant 
code amount obtained when the input signal 
blocks are encoded in a unit consisting of a plu- 
rality of input signal blocks; 

e) changing means for changing the quantiza- 
tion parameters selected by said selection 
means in accordance with an output from said 
detection means; and 

f) encoding means for encoding the orthogonal 
conversion coefficients from said orthogonal 
conversion means using the quantization 
parameters changed by said changing means. 

13. An apparatus according to clause12, wherein 
the input signal is an image signal. 

14. An apparatus according to clause 13, wherein 
said detection means detects the characteristic on 
the basis of a maximum amplitude value of AC 
components of the orthogonal conversion coeffi- 
cients. 

15. An apparatus according to clause 12, further 
comprising: 

discrimination means for discriminating 
whether the input signal is a luminance compo- 
nent signal or a color component signal, and 
wherein said changing means changes the 
quantization parameters selected by said 
selection means in accordance with an output 
from said discrimination means. 

16. An apparatus according to clause 12, further 
comprising: 

recording means for recording encoded data 
encoded by said encoding means on a record- 
ing medium. 

17. A code conversion method in which blocks of 
converted image data are quantized for subsequent 
encoding, wherein quantization parameters for said 
blocks are selected in accordance with compari- 
sons between the quantization results of selected 
quantization parameters and a target code length. 

18. A coded image data signal in which blocks of 
converted initial image data have been quantized 
and encoded, wherein the quantization parameters 
for the blocks have been selected in accordance 
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with comparisons between the quantization results 
of selected quantization parameters and a target 
code length. 

19. A recording medium carrying a coded image 
data signal as set out in clause 18. 

Claims 

1. An encoding apparatus for dividing image informa- 
tion into blocks each consisting of a plurality of pix- 
els, and encoding the image information by 
performing orthogonal conversion and quantization 
in units of blocks, comprising: 

a) detection means for detecting a local fine- 
ness characteristic of the image information 
from orthogonally converted conversion coeffi- 
cients; and 

b) control means for controlling a quantization 
characteristic in accordance with an output 
from said detection means. 

2. An apparatus according to claim 1 , further compris- 
ing: 

recording means for recording encoded data 
on a recording medium. 

3. An apparatus according to claim 1 or claim 2, 
wherein said detection means detects the fineness 
characteristic on the basis of a DC component of 
the conversion coefficients. 

4. An apparatus according to claim 1 or claim 2, 
wherein said detection means detects the fineness 
characteristic on the basis of a distribution state of 
AC components of the conversion coefficients, and 
a DC component. 

5. An encoding apparatus comprising: 

a) orthogonal conversion means for orthogo- 
nally converting image information divided into 
blocks each consisting of a plurality of pixels in 
units of blocks; 

b) quantization means for classifying image 
data converted by said orthogonal conversion 
means into at least two classes, and quantizing 
the image data with a constant quantization 
width in units of classes; 

c) control means for controlling the classes in 
accordance with an average luminance level of 
the image data orthogonally converted by said 
orthogonal conversion means; and 

d) encoding means for encoding the image 
data quantized by said quantization means. 



6. An apparatus according to claim 5, wherein said 
control means may control quantization widths in 
units of classes in place of controlling the classifica- 
tion. 

s 

7. An apparatus according to claim 6, further compris- 
ing: 

recording means for recording the image data 
w encoded by said encoding means on a record- 

ing medium. 

8. An encoding apparatus comprising: 

15 a) input means for inputting image data; 

b) block forming means for dividing the input 
image data into blocks; 

c) conversion means for orthogonally convert- 
ing the image data blocks; 

20 d) adjustment means for adjusting conversion 

coefficients of the orthogonally converted 
image data on the basis of an average lumi- 
nance level of the orthogonally converted 
image data; and 

25 e) encoding means for encoding the conver- 

sion coefficients adjusted by said adjustment 
means. 

9. An apparatus according to claim 8, wherein said 
so input means comprises image pickup means for 

outputting a video signal. 

10. An apparatus according to claim 8 or 9, further 
comprising: 

35 

recording means for recording the image data 
encoded by said encoding means on a record- 
ing medium. 

40 11. An encoding apparatus comprising: 

a) input means for inputting image data; 

b) block forming means for dividing the input 
image data into blocks; 

45 c) orthogonal conversion means for orthogo- 

nally converting the image data blocks; 

d) quantization means for quantizing the 
orthogonally converted image data; 

e) encoding means for encoding the quantized 
so image data; 

f) detection means for detecting a movement of 
the image data; and 

g) control means for controlling a quantization 
characteristic of said quantization means in 

55 accordance with said detection means. 

12. An apparatus according to claim 11, further com- 
prising: 
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recording means for recording the image data 
encoded by said encoding means on a record- 
ing medium. 

13. An apparatus according to claim 11 or 12, wherein s 
said input means comprises image pickup means 
for converting optical information into an electrical 
signal. 

14. An encoding apparatus comprising: w 

a) input means for inputting image data; 

b) block forming means for dividing the input 
image data into blocks; 

c) orthogonal conversion means for orthogo- is 
nally converting the image data blocks; 

d) quantization means for classifying the image 
data converted by said orthogonal conversion 
means into at least two classes, and quantizing 
the image data with a constant quantization 20 
width in units of classes; 

e) detection means for detecting a movement 
of the image data; 

f) control means for controlling the classes in 
accordance with an output from said detection 2s 
means; and 

g) encoding means for encoding the image 
data quantized by said quantization means. 

15. An apparatus according to claim 14, wherein said 30 
orthogonal conversion means performs DCT con- 
version. 
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